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GRAPHICAL USER INTERFACE AND 
METHOD FOR DISPLAYING MESSAGES 

Field Of The Invention 

5 The present invention relates to messaging systems and, in particular, 

to a messaging system including a graphical user interface for displaying messages. 



Background Of The Invention 

Voice messaging systems are common in today's business community. 

1 0 Most business organizations or enterprises make use of a private branch exchange 
(PBX) to direct a caller's telephone call to the appropriate extension of the called 
party. If the called party is unable to answer the telephone call, the telephone call is 
forwarded to a voice messaging system which allows the caller to leave a voice 
message in the mailbox assigned to the called party. Messages left for called parties 

1 5 within the business organization can be retrieved from memory by calling the voice 
messaging system using a telephone and entering appropriate commands via a touch- 
tone keypad. Retrieved messages can be played, forwarded or deleted. An example 
of a voice messaging system of this nature is the VoiceMemo U® sold by Centigram 
Communications Corporation of San Jose, California, 

20 In addition to voice niessages, commimications within business 

organizations are also often stored in facsimile and text formats. In the past, separate 
messaging systems have been used to handle these different types of communications. 
Unfortunately, prior art messaging systems designed to handle one type of 
communication have not provided any means to interact with messaging systems 

25 handling other types of conununications. This has required users to access each 
messaging system individually to retrieve messages and has required business 
organizations to maintain and manage multiple messaging systems separately. As a 
result, it has been necessary to establish separate accounts, address lists and message 
mailboxes in each messaging system for the various users in the business 

30 organizations. 

More recently, attempts have been made to intercormect different messaging systems 
to provide access to different types of messages from a single point. For example. 
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U,S. Patent No. 5,349,636 to Irribairen discloses a system and method for voice mail 
systems and interactive voice response (TVR) systems. The Irribarren system includes 
a voice message system and a text message system integrated via a network which 
coordinates the functions of each individual message system. A user may access 

5 messages stored in the voice message system and in the text message system via a 
single telephone call. Although this system allows access to different types of 
messages, the voice message and text message systems require separate management. 

The current trend is to integrate these various messaging systems to 
allow users to access all types of ponununications once a connection is made to the 

10 messaging system. To that end, unified messaging systems have been developed to 
provide users access to virtually all of their communications. Messaging systems of 
this nature store all messages for entities within the enterprise at a common location. 
The entity may be an individual, group, department, or any appropriate logical 
organization. Users accessing the messaging system via a telephone, desktop 

15 computer or other communication device, have access to all of their messages 

regardless of message type and regardless of the type of communication device used 
to access the messaging system. Appropriate message translators such as text-to- 
speech (TTS) converters, speech-to-text (SST) converters etc. are included to enable 
users to retrieve messages stored in formats not supported by the communication 

20 devices used to access the messaging system. 

When a user accesses a messaging system of this nature through a 
personal computer, the messages in the user's mailbox are presented to the user via a 
graphical user interface established by the messaging software executed by the 
personal computer. As an example, well known messaging software of this nature, is 

25 sold by Microsoft Corporation under the name Microsoft Outlook®, The graphical 
user interface presents forms (windows) to users to allow users to compose and read 
messages. In unified messaging systems, the messages may be of voice, facsimile, 
text and graphic types. 

Depending on the type of message composed by a user, a message may 

30 be placed as an attachment to the message. Figure 1 shows an example of a electronic 
mail (email) message composed using a compose form 10 produced by Microsoft 
, Outlook® from Microsoft Corporation, The composed message includes message 
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properties (e.g., to, from and subject) and a message body 12 including the text of the 
message. The message body 14 also includes three attachments, including a text file 
(status.txt), a Microsoft Word® document file (txtDocument.doc), and a bitmap file 
(connectd.BMP). In the cas eof av mified message system, a voice message would 

5 also appear as an attachment to flie e-mail message. 

When the message is delivered to a recipient, the received message is 
presented to the recipient in a similar form. Figure 2 shows an example of the email 
message in a read form 20 provided by the recipient's messaging software, namely 
Microsoft Outlook® from Microsoft Corporation. 

10 If the recipient receiving the message replies to the received message 

or forwards the received message to yet another user, the original message is placed in 
the reply or forwarded message as an attachment. Such an attachment is commonly 
referred to as an embedded message. The attached reply or forwarded message is 
typically represented by an icon in the body of the message. The icon representing 

15 the attachment preserves the message header or envelope information. A recipient of 
the reply or forwarded message must double-click on each icon within the body of the 
message separately to read the forwarded message and the original message. As will 
be appreciated, for multi-generation messages, a recipient may be required to open a 
number of messages, many levels deep to follow the commimication history of a 

20 message. Not only that, each time an icon is double-clicked, Microsoft Outlook opens 
a new window to display the underlying message. This of course makes it difficult to 
read multi-generation messages. 

Thus, there is a need to provide an improved messaging system and 
graphical user interface foLdispIaying messages. 

25 

Summary Of The Invention 

The present invention provides a graphical user interface that displays 
messages to a user in a manner such that attached or embedded message (as well as 
attachments to the embedded messages) within a message can be easily viewed with 
30 reduced user effort. ..L '1/. 

According to one aspect of the present invention there is provided a 
messaging system of the type supporting computer access to user messages, the 
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improvement comprising a graphical user interface displaying messages to a user 
accessing said messaging system via a computer and deconstructing messages to 
provide a visual indication of all embedded messages and attachments therein. 

According to another aspect of the present invention there is provided 
5 a graphical user interface to display a selected message to a user in a form on a 
computer screen. The graphical user interface includes: a first display area within 
said form presenting said selected message and presenting accompanying attachments 
and embedded messages as selectable icons; and a STOond message area within said 
form presenting all components of said selected message separately to allow said user 
10 to select directly individual components of said message for display. 

According to still yet another aspect of the present invention there is 
provided a messaging system. The messaging system includes: a messaging server 
executing a messaging application and including memory to store user messages; and 
at least one user computer connected to said messaging server via a network, said user 
1 5 computer executing messaging software to allow a user to compose messages and to 
retrieve messages stored by said messaging server, said messaging software being 
responsive to user input and including a graphical user interface to display user 
messages stored by said messaging server, said graphical user interface presenting a 
form to display a selected user message in response to user input, said form providing 
20 a visual indication of all components within said selected message. 

The present invention provides advantages in that all embedded 
messages within a multi-generation message are displayed in a single window. This 
allows a user to select any embedded message within a received message without 
requiring the user to click on icons to expose those embedded messages. Once an 
25 embedded message is selected, the application associated with the embedded message 
is invoked. 



Brief Description Of The Drawings 

An embodiment of the present invention will now be described with 
30 reference to the accompanying drawings in which: 

Figure 1 shows a prior art messaging compose forai presented to a user 
, during composition of a message; 
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Figure 2 shows a prior art messaging read fonn presented to a user 
when the message of Figure 1 is forwarded to that user by another user; 

Figure 3 is a diagrammatic overview of a unified messaging system in 
accordance with the present invention; and 
5 Figures 4A-7 illustrate operation of the invention according to one 

embodiment of the invention. . 

Detailed Description Of The Invention 

The present invention relates generally to a graphical user interface to 

10 display embedded messages within a message. The graphical user interface can be 
implemented in virtually any messaging system, such as electronic mail systems, 
unified messaging systems, voice mail systems, etc. which support computer access to 
user messages. An embodiment of the present invention will now be described 
implemented in a unified messaging system. 

1 5 Turning now to Figure 3, a messaging system is shown and is 

generally indicated by reference numeral 100. Messaging system 100 includes a post 
office 102 communicating with a telephony messaging server 104. The post office 
102 runs on a separate server and is connected to the telephony server 104 via a local 
area network 106. Post office 102 communicates with clients 108, only one of which 

20 is shown, via a local area network, modem or other communication channel 110. Post 
office 102 and telephony messaging server 104 also communicate with external 
messaging systems via a wide area network 112. 

The post office 1 02 provides message storage and delivery facilities for 
users of the messaging system 100 and includes mailboxes in which messages for the 

25 users are stored. The post office 102 handles and stores user messages regardless of 
format. Thus, the post office 102 stores voice messages received from the telephony 
messaging server 104 as well as text messages, facsimile messages, graphics 
messages etc. received from client 108 and/or wide area network 1 12, The post office 
102 also maintains a directory database of user information including addresses, 

30 locations and addressing related infonmation as well as user preference records as will 
be described. The directory database infonnation is accessible, retrievable and 
• updatable using database type queries. In the preferred embodiment, post office 102 
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runs commercially available post office software such as Microsoft Exchange ® sold 
by Microsoft Corporation of Redmond Washington. 

In one embodiment, telephony messaging server 104 is a model TS800 
telephony server or similar model provided by Mitel Corporation of Ottawa, Ontario. 
5 The telephony messaging server 104 executes a voice messaging application to handle 
incoming telephone calls which cannot be completed. As is well known to those of 
skill in the art, the voice messaging application includes a speech file administrator 
which retrieves prerecorded voice message prompts from a database to direct a caller 
to leave a message for a particular called party. Messages recorded by the voice 
10 messaging application are conveyed to the post office 1 02 for storage in the 

appropriate mailboxes. The voice messaging ^plication also handles incoming user 
calls to allow users to retrieve messages stored in their mailboxes. 

Telephony users may access the voice messaging application using a 
typical telephone or telephony device 114 providing telephone functions that is either 
1 5 directly cormected to telephony messaging server 1 04 or connected to the telephony 
messaging server 104 through a private branch exchange (PBX) and a publicly 
switched telephone network PSTN (not shown). During access, users enter touch- 
tone commands and passwords to retrieve messages from their mailboxes in the post 
office 102. The voice messaging application calls the speech file administrator, which 
20 provides the appropriate voice message prompts to navigate users through the voice 
messaging application. During message playback, if a message stored in a user's 
mailbox is in a format not supported by the telephone or telephony device 1 14 used to 
access the messaging system 1 00, the voice messaging application calls an 
appropriate message translator to convert the message into a form which can be 
25 played back to the user. 

The telephony messaging server 104 conununicates with a directory 
cache 1 1 8 that is updated by the post office 1 02. The directory cache 1 1 8 stores a 
subset of the information stored by the post office 102. Specifically, the directory 
cache stores addressing information for users and groups associated with the 
30 messaging system. The telephony messaging server 104 accesses the directory cache 
1 18 in response to user and caller queries made via a telephone device 1 14 to reduce 
, directory search times and provide a fast addressing service. Further details of the 
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directory cache are described in Applicant's co-pending application identified as U.S. 
Patent Application No. fAtt.Dkt.No. MITEP003) , filed on February 25, 

1999, entitled "AUTOMATIC SYNCHRONIZATION OF ADDRESS 
DIRECTORIES FOR UNIFIED MESSAGING", which is hereby incorporated by 
5 reference. 

Client 108 in this embodiment, is associated with or in the form of a 
computing device such as a personal computer 120. Through personal computer 120, 
a user can access voice message, facsimile messages, electronic mail messages etc. 
stored in their post office mailbo^. The user can also use personal computer 120 to 

1 0 perforai messaging functions such as create, attach, read, modify, reply, forward, 
store and delete messages of various types- 

In one embodiment, the personal computer 120 runs Microsoft 
Outlook® client messaging software sold by Microsoft Corporation. The client 
messaging software provides a graphical user interface (GUI) to display the user's 

15 messages held in their post office mailbox and to allow the user to invoke messaging 
functions. Since the mailboxes store messages in different formats, it is preferred that 
the personal computer 120 includes appropriate hardware and software to allow all 
message types to be retrieved. In cases where the personal computer 120 does not 
include the hardware and/or software necessary to support certain message types, 

20 appropriate message translator can be called to convert the messages into a form 
compatible with the personal computer 120. 

The invention is further explained with reference to Figure 4A-7 which 
illustrate operation of the invenlion according to one embodiment of the invention. 

When a user access their mailbox and wishes to compose a message to 

25 be sent to another user of the messaging system 100, the messaging software presents 
a compose form 30 to a user on a display screen as shown in Figure 4A. The user is 
then able to compose a desired message to be sent to a recipient. The representative 
message in the compose form TO contains a voice attachment 32. The voice 
attachment 32 could have been created by the user using a voice recorder control area 

30 34. After the message has been composed it is sent to the recipient. 

Thereafter, when the recipient accesses their mailbox to read their 
messages and selects the message to be read, the messaging software presents a read 
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fonii 40 on a display screen as shown in Figure 4B. The read form 40 contains a list 
view 42, a message body 44, and a properties area 46. The message body 44 is 
similar to a conventional read form and displays the message together with a voice 
attachment icon 48. The list view 42 display the message and all its attachments or 

5 embedded messages in a list format. The list view 42 indicates that the message from 
the sender has a voice attachment. 

Suppose then that the recipient of the message they have received 
using the read form 50 replies back to the sender (or forwards the message to another) 
such that the reply message includes not only the original message but also additional 

10 attachments, namely a voice attachment and an image file (i.e., screen.jpg). Then, 
upon the original sender (now the recipient) accessing their mailbox, the messaging 
software presents a read form 50 on the display screen as shown in Figures 5 A and 
5B. The read form 50 contains a list view 52, a message body 54, and a properties 
area 56. Here, the message body 54 indicates the voice attachment by a voice 

1 5 attachment icon 58, and the image file by an image icon 60. In addition, the message 
body 54 include a message attachment icon 62 that indicates that a message is 
attached. 

The list view 52 provide detailed information regarding attachments 
and embedded messages with respect to the reply message. Figure 5A illustrates a 

20 first portion of the detailed information in the list view 52, Figure 5B illustrates a 
second portion of the detailed infonnation in the list view 52. Notice that by 
reviewing the information in the list view 52, the recipient of the replay message is 
able to easily ascertain from the read form 50 that the received message has two 
attachments, one voice and one image file, and that the received message also has an 

25 embedded message. Each of these attachments or embedded message identified in the 
list view 52 can be selected by the recipient and thus directly accessed without having 
to open any other windows or forais to retrieve any of the attachments in the list view 
52. Hence, as an example, the recipient can directly select the voice attachment to the 
original message without having to open or select the embedded message to which the 

30 voice attachment is attached. 

Thus, in the case of multi-generation messages where attachments and 
embedded messages may be deeply embedded in the message, the messages arc fixlly 
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de-constructed into their components and presented separately. This allows the user 
to select the message or any attachment or embedded message within message. When 
the message, an attachment or an embedded message is selected from the list, the 
messaging software invokes the application associated with the selected message or , 
5 attachment. 

Figure 6 illus trates a view on the display screen that occurs after the 
recipient selects (e.g., double-clicks using a pointing device) the message attachment 
icon 62 from the read form. In such case, an additional fonn 64 (window) is opened 
and represent the attached message. Note that the attached message is the same as the 

10 read forai 40 in Figure 4B for the reception of the original message. 

Figure 7 illustrates a view of a short or condensed version of a read 
form 70. The read form 70 includes a list view 72 but conserves space by not also 
providing a message body or message properties. The list view 72 is similar to the list 
view 52 in Figures 5 A and 5B although pertain to a different message, 

1 5 The invention can also be embodied as computer readable code on a 

computer readable medium. The computer readable medium is any data storage 
device that can store data which can be thereafter be read by a computer system. 
Examples of the computer readable medium include read-only menlory, random- 
access memory, CD-ROMs, magnetic tape, optical data storage devices. The 

20 computer readable medium can also be distributed over a network coupled computer 
systems so that the computer readable code is stored and executed in a distributed 
fashion. 

As will be appreciated, since multi-generation messages are de- 
constructed and displayed, a user is provided with quick and easy access to all 
25 components of these types of messages. Although a preferred embodiment of the 
present invention has been described, those of skill in the art will appreciate that 
variations and modifications may be made without departing from the spirit and scope 
thereof as defined by the appended claims. 
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We Claim: 

1. In a messaging system of the type supporting computer access to user 
messages, the improvement comprising a graphical user interface displaying messages 
to a user accessing said messaging system via a computer and deconstructing 
messages to provide a visual indication of all embedded messages and attachments 
therein. 

2. The messaging system of claim 1 wherein said graphical user interface 
deconstructs messages when said messages are selected by said user. 

3. The messaging system of claim 2 wherein said graphical user interface 
presents said embedded messages and attachments in a list. 

4. The messaging system of claim 3 wherein said graphical user interface 
allows said user to select embedded messages and/or attachments in said list to invoke 
applications associated therewith. 

5. A graphical user interface to display a selected message to a user in a 
form on a computer screen comprising: 

a first display area within said form presenting said selected message 
and presenting accompanying attachments and embedded messages as selectable 
icons; and 

a second message area within said form presenting all components of 
said selected message separately to allow said user to select directly individual 
components of said inessage for display. 

6. A graphical user interface as defined in claim 5 wherein said second 
display area presents said components in a list. 



7. 



A messaging system comprising: 



a messaging server executing a messaging application and including 
memory to store user messages; and 

at least one usct computer connected to said messaging server via a 
network, said user computer executing messaging software to allow a user to compose 
5 messages and to retrieve messages stored by said messaging server, said messaging 
software being responsive to user input and including a graphical user interface to 
display user messages stored by said messaging server, said graphical user interface 
presenting a form to display a selected user message in response to user input, said 
fomi providing a visual indicatioii of all components within said selected message. 

10 

8, A messaging system as defined in claim 7 wherein said components 
include attachments and embedded messages within said selected message. 

9, A messaging system as defined in claim 8 wherein said forai presents 
15 said components in a list. 

10, A messaging system as defined in claim 9 wherein said messaging 
software is responsive to selection of any component in said list to invoke the 
application associated with said selected component. 

20 
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